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Volume 4 No. 3. of INVESTIGATIONS IN SCIENCE ^EDUCATION contains 
abstracts and criticises of eleven journal^ articles . No attempt has 
been made to cluster these articles although' three of them refer 

to achievement, in some aspect, and several others focus on teachers- 

[ • • 

their verbal behaviors, methods for educating, or characteristics 
to be considered when evaluating teacher performance,^ Readers 
may identify other aspects of interest . that could serve to relate 
.one article to another. ' • . / 

As Stan Helgeson has written in past "Notes," w'e continue,ato 

.• ■ ' ■ ■ ' .■ '■T'<'>> 

. •.- j'^ ' 
itivite the readlsrs of I^S.E. to make use of this publicatioji as 

a vehicle fbr dialogue . If you have suggestions for methods for 

accomplishing this objective,' please share them with us/ 



Patricia E- Blosser 
Editor 



V'/T ^ Robert L. Steiner 

"4'%' " - Associate Editor 
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Volume 4, Number 3, 



NOTES from the editors 



Anderson, Elaine J. ; Hermes. T. Demelo; Michael Szabo; 
and George Toth. "Behavioral Objectives, Science 
Processes, and Learning from Inquiry--firiented 
instructional Materials b" Science Education , 59(2); 
'263-271-, 1975. . 

Abstracted by CLAUDIA DOUGLASS. . 



Brown, L. M. ; P. W. Tweeten; and C. Pacheco. "Attitudinal 

Differences Among Junior High School Students, Teachers, 
. ' and Parents on Topics, of .Current Interest." Science 
Education, 59 (4): 467-4 73, 1975.. " / * 

Abstracted by DOROTHY GABEL 



Deiter, Donn L. and Paul B. Hounshell. "Biology Teacher , 
'Evaluation: Factors Significant in the Process." . 
> Journal of Research in Science Teaching , 12(2): 
139-14 6, 1975. . ^ ' . 

Abstracted by JOHN E. LUTZ.'. 

Graybill^ L. "Sex Differences in Problem •Solving Ability." 
Journal of Research iir-Science Teaching , 12:341-346, 
1975. 

Abstracted by DAVID P.. BUTTS . ^ - 



Jaus, Harold H. "The Effects of Integi;;at^ Science Process 
Skill 'Instruction on Changing f^cRSr Achievement and 
Planning Practices." Journal bf\Research< in Science 
Teaching , 12(4) :'4 39-477, 1975. _ . 

-Abstracted by WILLIAM S. LA SHIER 



Kaplan, Eugene H. ^ "A Model Biology Curriculum- for Heterogen- 
eous Se^^enth Grade Biology Classes Containing Culturally 
Deprived Students (in Is:raelOs II. The Construction -of 
the Model." Science Education , 59(3): 321-332, 1975. 

Abstracted by ELLEN STEPHANIE SIMMONS .V 



Nelson, Miles' A. ^"Evaluation of a Cooperating Teacher \r 
Training Program." Science Education , 59(4) : 505- 
515^, 1975. ^ ; / . ^ 

Abstracted by HANS/0. ANDERSEN. ^ 



Seymour, Lowell A. and Lawrfence F. Padberg. "The Relativ.e 
Effectiveness of Group and Individual Settings in a 
Simulated Problem- Solving Game." Science Education , ■ 
59(3): 297-304, 1975.^ 

Abstracted by LYNN W. GLASS ./ . . ....... . . 



Charlfes 0 . Matthews. ."Using^ Macroanalytic TecKniques to 
Study Teacher Behavior Patterns." Jourrial of Research 
in. Science Te.achi:ng , 12(3) : 221-22?, . 1975. ^ 

Abstjracted by THOMAS P. EVANS I. . . . . 

Tamir, P.. and E. Jungwirth. "Students' Growth'*as a Asult 
of Stud^ying BSCS Biology, for 'Several Years." Journal 
of Research^ in Science Teaching , 12(3) : 263-279, 1975. * 
.Abstracted by »CHRIS A. POULER . 

Williams, Russell B*. "A Method of Integrating •Chemis.try 
, Subject Matter into Biological Science Instruction." 
Science Ed ucation, 59 (2) : 167-175, 197.5. ^ . 
- Abstracted by LINDA R. DE TURE 
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868,^ and Learning from 
|Ls ; ' ' Science Education, 



-Anderson7--Elalne- -J^;"HerTnes -^^^^^ George-Toth . 

"Behavioral Objectives, Science Proces e 
inquiry-oriented Instructional Materle 
.59(2) :263~271, 1975. | f 

Descrlptors—^Academic Achlevefment ; ^^fBehavloral Objectives; 
Biology; Cognitive Processes; '^EdUcaiional Re:aearch; Inquiry 
'Training; ^Instruction; Learning Pifo^esses; Science Education; 
^Secondary School Science j : % . 

Expanded Abstract and Analysis Prepared Especiiplly for I.S.E. by . 
Claudia Douglass, Central Michigan University, 



Purpose 



The primary purpose of the research was to inyi^stlgate the effect of 
behavioral objectives on immediate^ learning fro A an inguiry-oriented^ 
Instructional program.. The achieyement on knowledge level and higher 
than knowledge level ite?ms of a piast test was cGm|ared for students 
who scored h'igji and students wife scored ijw on ^ jtest of ability «to 
use scientific processes.^ The lAVeractl^n of aUtudent's ability to , , 
use process skills and the^ preseice of pbjectiv^j was also invesfi 
gated. ^ 



The specific hypotheses were as follows: 



1, \ there is no significant 
receive Behavioral obje 



difference between learners who w 
jtlves and those wiio receiye a 
placebo usln^ the crlteillon of specific siibject matter ' 
^achievement,- W 



there Is no significant' jdlfference between learners who scbr^- 
low or high on a test ofijablllty to use scientific processes- 



using the criterion of s] 
and 



lecific subject matter! achieveiaent. 



there is no significant .nteract ion between the\ treatment 
conditions (behavioral oBjectlvep or placebo), and learner 
facility Vlth scientific jprocesses using .th,e criterion- of 
specific subject matter Achievement. , 



Research into the effects ^of behaviorally stated objectives on learning 
'has produced mikfed results. Many 'investigations ^have shown favorable 
outcomes in terms of achievement and retention while others have shown 
negative ^results' with the .addition of objectives. Gathering informa- 
tion from many studies cited in. this .paper, Anderson et al . claimed 
that a cbrifoundlng factor in the literature, reports was that neither 
thp cognitive level of the'^jeCtives nor the criterion measures had 
,been held,. -Constant . ^ ' 

A . . ■ ' ' ' ■■ • ♦ ■ 

* ' ■ ^ , ■ ' ' " '.,1 

'When knowladtoe^^^ application, and analysis level objec-?,' 

f£±ed and employed with programmed instruction, signi-- 

v*^4^ ■ • ' - 

ficant diffdr^ces in' achievement were noted between the levels of ^( 
C9^iiq)if6ft^^iu^4:on. and application. However, no difference was demonstrated 
beiweenl^i^ (Stedman, 1970). Anderson 

and. her colleagues designed a controlled study which. in part demon- 
stjf'ated tlie role of ^the cognitive level of the objectives. Their 
fnt'i^utr was. to carry, the work of Stedman (1970) a step farthei^. 



Resea^ j ^iJesign and Procedure 



A „post test-only control grbtip design was employed -(Campbell, and Stanley 
1963). The independent variables were the treatment cbnditions (receiv- 
ing' objectives or receiving a placebo) arid facility with scientific 
processes^ (hi^ or low). The dependent variable was a subject matter 
achievement test. ' # ' * 

The, subjects were 4o"Wudents enrolled in aA'^elementary scfenqe methods 
•course in a major Eastern university. . 1> 

The evaluation instruments Were the Process of Sci^ce Test (POST) and 
a ^subject matter achievement test designed to contain knowledge level 
and higher than knowledge level 'questions.' The overall reliability of 
this test was "^^l ^ '^^^ while the reliability^for thos/ 16 items 



measuring knowledge level cognition was KR^q - >65, and those 16 Iteiiis 
measuring higher. than knowledge level cognition was KR2Q « .60. 

The Instnictional mat^ferial was a shprt unit based upon the- BSCS Inquiry 
Slide Set Structure and Function ; Control of Bloodr Sugar : A Homed- 
static Mechanism , A' set 6f 24 behavioral objectives (16 knowledge and. 
8 higher than knowledge level) was idevelopeci and validated 'by. a panel 
of Judges. These were incorpora.ted into an introductory passage^whiOT: 
was given to the^tiidents just prior to the instruction. .The controj. 
group received a passage containing an unrelated discussion of a newly 
developed science curriculum. ' , . " 

Two weeks pAor to the treatment the sgtibjects completed *the POST.' It 
was scored and the subjects were divided into two groups based on the 

■» 

median score. Then the students were randomly \ assigned to treatment 
groups and administered^ the treatment passage. Following no^ introduc- 
tion, they participated' in a 75-ininute class on homeostasis conducted 
by an experienced biology teacher. . 

Findings ' . 

•■ < ' ^ ■ ■ ■ . ^ \ 

The study showed that there was a, significant differerice in criterion 

subject matter achievement between ^students who; received^^havioral 

objectives and those, who received a placebo (F = 4.7, df = 1,37, p < 

.05)'. Learners who scored high on the POST did significantly better 

on the criterion subject matter achievement measure than students who. 

siorqd low on the POST (F \= 12.4, df = 1,37, p<.01). Finally, the 

interaction between thetreatment and the ability to use- scientific . 

processes was not signlfj.cant (F value not reported) . A table, was 

presented which sHowed without statistical proof that students 'did 

better on the knowledge level subtest of the criterion measdre than 

on the higher than kirowl fed ge level subtest, maintaining the same 

patterns with regard to ability to use science processes and treatment 

group performance (Table III).*. ' * , . 



interpretation ^ ^ ' i 

c . • ' ■ • ■ .■ • 

The results of the study suggested that inquiry-oriented biology 
materials that incorporate behaviorally stated objectives enhanced . 
immediate learning and that facility^with scientific process skills^ 
increased student perfo,rmance on the criterion achievement measure. 
The researchers concluded that the s^tudy reinforced the assunptibn 
that objectives enabled learners to* retain essential! material and ^ 
to organize complex cognitive processes and that t^e de'gree of 
facilitative effect of the objectives was probably related to the 
quality and quantity of the instruct ionai material. ' ' 



\ ABSTRACTOR'S ANALYSIS 

It has beet^ stated several times that research dealing with behavioral 
objectives has been inconclusive (Duchastel and' Merrill, 1973; Jlowe 
and DeTure, ^^975); " Rowe and DeTure (19^) reco.mmended that if one 
were, to "pursue research. <3^ealing with objfe'ctives, he/she should refine 
the topic or- concep*tualize it in a different way. Anderson e\ al . did 
just tjiat by incorporating Vthe notion' of cognitive level and the 
investigation of an interaction. The rationale ^or the study would 
have been strengthened if, rather than dwelling on the current state 
of confusion, literature dealing with the ifeasgns for expecting an . 
interaction. and -the inclusion of cognitive levels and^ science process 
abilities had been incorporated. 

The research methodology was the weakest aspect of the study. Inprove^ 
ments could have been made in the choice of the sample, the' statement - 
of validity of the POST, and the reporting of the r'esults. A more, 
appropriate sample would Tiave been one which had no previous knowledge 
of behavlo.ral objectives. Properly trained preservice elementary ' 
teachers should be able to recagnize the objectives and their purpose, 
A sample of individuals not familiar; with tjie purpose of * obj ectlves * 
would have beeji more genera!}.izable . ^ ■ ' * 




ERIC 



The POST. was ^ised to establish indepehd^ent vaflfflSjp^^grbupii^g, however, 
validitv and reliability data' were lacking from the ?report. A' review 

^ ^ - 1. 



of this instrument indicated that the .only norms for it were estab- 
Tished" f oY TS^^ 

for students in grades 10-12. It was noted in that same review that 
several of the items tested general intelligence and reasoning ability 
rather than the actual processes of science (Euros, 1972). It would 
be interesting to know the correlation betwe^en intelligence and the . 
POST. If the correlation wajs between^ .4 and .6, the results may be 
confounded and an analysis of covariance would be more appropriate 
(Cochran, 1957). ^ " 

A minor point dealing with the repor^^ed reliabilities of the achieve- 
ment tests was that a KR2^ was used as the reliability figure for the 
entire test while a KR^q was uded for the subscore portiqns. To ;/ 
improve continuity, it would have been more apprOpriate^o use the 
same measure in both cases. The author o'f this "review was unable to ^ 
find justification for this procedure and . none was given l^y Anderson , 
et al . (Richardson and Kuder, 1939^^ Thorndike, 1971). The reeults were 
analyzed and presented clearly. .A two-way analysis of -yariance was an. 
appropriate statistical tool to use; however, a complete ANOVA tablef: 
including the interaction values would have been more -useful. A tech- 
nical point regarding the resultSvis that the- ptobability values 
reported at the bottom' of Table I wejre reversed and; should have read 
p^< ,05 and p< .01. The reportihg of results such as those shown, in 
Table III of Anderson* s paper is' to be complemented. So often suppor- 
tive data which do not meet the strictest research criteria are omitted 
from the literature and other investigators, in the area never gain 
access to the information. j The choice of design, specifically one' 
which- omitted a pretest, .was ntost appropriate in that a pretest x. 
treatment interaction likely would have appeared. , ^ 

The results were generalized beyond the samplei It was implied that 
they. suppo;p ted the work of others regarding immediate learning and 
retent^^. This study did not deal with retention in any way and 
this discussion was but of place. The results and implications of 
the research . conducted in this study will help clarify the current 
state of' the Literature in the area of .behaviofal objectives and 
their meaning." The recommendations for further Research regarding 



this particular study are that it be repeated with a larger and more 
appTrop^ 

Carefully controlled and conducted studies are always of value in 
science education and especially in an area such as that addressed 
by? Anderson and her colleagues. 
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Purpose > 

This study examines the *'d^.f ferences between adolescent, ;tpacher# and 
parent attitudes on topics of current interest.* , Differences a:ccording 
to sex are also studied. ^ ' ^ 



Rationale 

Brown (1973) has shown that science teajshers tend ^o de-emiihasize con- 
cepts th^ are of social nature which are relevant to .adolescents.^ If 
students.* values differ from those pf adults, schools m^y wish to pro- 
vide students the opportunity to clarify their values. •^^•^ 

Nb references to other research in this area' are given by the authors. 



Research Design and Procedure^ 

This study consists of a survey of junior high school students^^ te^^ers 

' ^ ' '^'^ 

and parents on their attitudes toward socially relevant ideas/ The 
■ ■ ■ • ., • ;■ * •■ ^ 

survey was conducted by students in two seventh grade life science > 
^ ' ' ^ ■ ' i/" » ^ 

classes at an upper-nniddle class, predominantly white junior high-^ 

schgol in Al>uquerque, New Mexico. The 60 junior high school students 

were paired and each pair interviewed three groups of pfeople: (1) three 

male and three female junior high school students, age^l to 14; (2) ^ 

two teachers., male or female;- and (3) four ^)arents, tw|%nothers and two 



fS^hers. . Although this- should have resulted ; In 360 interviews, otlly 
125 interviews were used dn the analysis. ' 

The- in4:erviews consisted of students' showing those being interviewed^ 
a picture card (10 tn all) depicting an item of societal importance. 
Topics included mai^ijuana,, police, school, baby, atom bomb/ smog, 
whiskey, teacher, army, and^cigaret'tes. The person being interviewed 
responded "by rating the. idea presented as (1) ivery good, (2)^ somewhat 
good, (3) so-so, (4) somewhat bad, or (5) very bad. 

Data were analyzed using a one-way analysis of variance on the scores 
for each topic according to the three classifications of those, inter- 
viewed: studient, teacher, or parent. 



Findings : 
The investigators reported the following findings^ 

1. No statistically significant difference in scores between 
males and females, using analyses of variance,- were reported. 

2. The scores of teachers and parents were significantly differ- 
ent from those of students on marijuana, police, •school, baby, 
teacher, and cigarettes as analyzed by Tukey's Honestly Signi- 
ficant'^Sifference Test (HSD) . The only significant difference 
between teachers' and parents' scores was on their view of the 
teacher. 

Interpretations ^ 

Adolescents perceive certain segments of current social issues differ- 
ently from the adults with whom they associate. Teachers should be 
cognizant of this fact and provide experiences in the curriculum to 
help Jjtudents^ develop their value system. 



' ABSTRACTOR'S ANALYSIS 

This study should be classified as a report on a school project con- ^ 
ducted by students rather than a research report. . The students who 
participated in^this worthwhile project probably benefitted more than 
those persons interested in research in this area. 

There are several flaws in the research design that makes one question 
both the internal and external validity of the survey. 

1, The sample of this study consists of persons interviewed by 
students that fall into categories of adolescents, teachers, 
and p^ents. Little is known about the saii?)le. No attempt ^ 

* • was made to interview a random sample. Each pair of students 

was to interview 12 p*prsons. ^Only 125 out of a possible 360 
were interviewed. This would certainly bias the sample as 
some students may be interviewing different numbers of persons, 
than others. 

2. The techniques used for interviews were not uniform. There 
is little evidence that all students used the same technique 
or the* person interviewed would respond in the same way to 

Afferent interviewers (low reliability) . 




3. Students interviewed teachers and parents who were known to 
them and with whom they closely associated. Responses of 
adults to children could very easily be biased in that the 
adults gave responses they wished children to emulate. 

> . 

In addition to the ^bbve, the .authors give very little rationale for 
the study and do not place it in a theoretical framework. In fact, 
only one reference is made to work done by others. 

^(Pl^ report is quite straight- forward and easy to understand. B^^use 
of the unequal numbers of persons in each category, Table VII becomes 
a little- difficult to comprehend. Perhaps these numbers would be best 



11 



represented as percentages so the reader could compare the proportion 
of responses in each category. ^ - -o ■. 

The, one value that this report has is that it brings to the attention 
of the reader that children do not share the same yaluep as adults and 
thiit this should be a consideration ill their education. Most teachers 
probably would not consider this new information, however, even though 
many may not include societal issues in their teaching. ; 
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Deiter, Donn L. and Paul B. Houiishell. "Biology Teacher Evaluation: 
Faetors Significant in' the Process Jctumal of Research in - 
- Science Teaching , 12(2) :139-l46, 1975, ' • 

Defecriptors~*Bias; ^Biology; Educational Research; Evalua- ' 
tibn;*Eval nation Criteria^ Science Education; ^Science 
Teachers; ^Teacher Characteristics 

Expanded Abstract and Analysis Prepared. Especially for I.S.E. by John 
E. Lutz, National Technical Institute for the Deaf and Rochester Insti- 
tute of Technology. 



Purpose 

> ■ « 

According to the authors^ the intent -c/f ^this study was to gain some 
unders'tanding about the evaluation of biology, teachers, 




Rationale 

The major [^assumptions identified by the authors for this study were: 

1. Criteria exist which characterize outstanding biology teachers. 

2. QBTA (Outstanding Biology Teacher Award) judges are appoiijited 

; for their ability to recognize outstanding biology teachii|g and 
these persons are competent to judge^^ biology teachers. 

, 3. , Judges employ these criteria when making decisions abou^the 
suitability of candidates for the award. 

; 4; A "value hierarchy" of criteria existsA with some criteria 

being of more importance than others in\evaluating candidates 
for the award. 

5. s Assessment of candidates for the award is subjective and indi- 
vidual judges value specific criteria differently • 



Research Design and Procedure 

This study was a descriptive evaluation of the traits and characteris- 
tics of otUistanding biology teachers as determined by OBTA program 
judges. It was planned to determine the importance of various eval- 
uation criteria used to define competent biology teachers. 

11 ^ 



♦ _ . . ■ . .• ■ . ■ / 

The study involved 220 judges from the 47-state selection committ^s 
active in the 1970 OBTA program. , A questionnaire was developed that 
included 111 it^ms which might have been used as criteria in the/ 
teacher evaluation i>r<5cess. Each of the judges was asked to ra^e 
the various criteria, according to the weight given them when eval- 
uating candidates for the award. Coiq)leted questionnaires weire 
received from .179 judges. " " ' 

Chi-square analyses assessed the variance between the . observed and> 
expected response, frequencies. Comparisons of ratings were also 
made between different judge groups. 



Findings . , 

Twenty-one factors •were identified as significantly important from 
the study and could be grouped into three major areas related to 
teachers' intrinsic personal traits, teacher-student interrelation- 
ships, and concerns for skills and proficiencies as a science teacher. 
Eight factors were rated significantly different between different 
judge-groitps. > 

^ ■■■ " . . ■ ^ ■■■r : . ' 

Interpretations . | - 

/ 

The authors stated that they did not want their conclusions to be 
interpreted as judgments of the OBTA program, altl^oiigh they'^saw it 
as a model for teacher evaluation by a professional group. They con- 
cluded that specific criteria exist which ar^ significant to competent 
judges and that various judges valued certain criteria differently, 
depending upon the judge's occupational role. . ^ 

ABSTRACTOR'S ANALYSIS^ 

The differences between research reports ^that command confidence and 
those that suggest reservations can be explained with ''these criteria,: 

' . ■ . ' .* 

' 12 ' ' 



1) clearly defined purpose, 2) detailed design and proceduS^s, 3) esti- 
mation of flaws, 4) ad^^quate; data analysis, and* 5) justifiable coriclu- 
sions. . This ^report will be .analyzed ' for. these criteria* 

1. The stated purpose of any study should include a brief descrip- 
tion of where the^tiidy fits into the general- structure of 
knowledge; /that is, a theoretical fr^ework gleaned from the' 
'literature' should show its jaeqi and importance. This repor 
was adequate in this tegard and included brief statements of 
concerns^ literature review, and assumptions, fbr the study. . 




/ ^ . . ■ ... . ... ; - - / 



2. Although a section of the f epoi;t .was labelled "Study Design," 
' a specific pre- or non-experimental dfesigri was not' identified. - 
Apparently, the descriptive sxirvey discussed by Novak (1963) 
cotild be assumed as the .model for this\study. Furthermore, a 
precise and clearly worded description of procedures was lack- 
ing. The. reader had tx> piece. togetl\er the procedures from- 
- several differ'ent sections ^and then still lacked a^, clear under- 
V standing of the instructions given to the OBTA j-udge^^-^fiid how - 
y evaliiafor bias Ws really determined. A test of tlje adequacy ^ 
ofv. design and procedural description ^es in' the re^licability 
of the study, from the directions 'given i,n the original export;' 
a replication from this report probably would not be gbssibie. 



/ 



3. No mentiotf was made of any constraints or limitaticAis of the 
study. An estimation of the effects of probable likLting 
factors would Kave been useful to help define the gengr^-liz- 
ability of the findings. Although the questionnaire .designed, 
for the study was based upon several apparently valid sources, ■ 
no confirmation of conterit validity was given and no discussion 
of other measurement concerns was included. Although the^ 

- return r^^|f t-he questionnaire was 81 percent (-a fine return), 
no discu^I^ of the poteiitial selective bias of the returns 
was included. 

4. Since this study investigated possible differences between dis- 
tributions and not between parameters, the appropriate statis-; 
.tics were nonparametric . The chi-square test for independence 
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permitted a relatively easy method of data collection and did 

not require ^sstimptlbns about the population. Apparently,- 

.■ • . : ■ . - , - ' • • • 

the 21 items identified as ' significant were sorted according 

to some logical grouping— the inclusion of a formal factor 

•c ' ■ • ' ■ • ■ • ^ • ■:5 ■ . •• ' ■ ■ . * • 

analyi^is;^tiight have helped partition iihese significant-cri- 
teria into sets for int'erpretatiori. ^. 

A major presenilation of data waa: accomplished through T^attle 

III; however, this presentation mf^ht Kaye been more useful 

if-itvhad lyeeii organized .differently." ' For examplfe, the. 

. > ' ; .• •' ■ * t^. * - •• . •. 

significant criteria coiii'd have been lifted in tha^first 

column, atid^^he results fii'om the varioiife^judge grojip pquld* 

have* followed infsucceeding columns with the response, cate- ' 

go ries "^collapsed into "Importanri' and '^Not Important." 

^lolnparisons of re^pon^e frequencies -for *a g^3?en criterion 

coiHd then bfe xhade tii^re easily between thi^ ;yarious . groups . 



The^bqpa'dly stated intent of this, stiidy was '/to discover , 
something .-about the evaluation of biologjr teachers." v This 
intent was .f lAfllled.— the frameiSJ^orlc of the 'listed 
assumptions a^rid' the analyzed' data, the^'ConclUsions ^ were :^ 
•justifiable. . . ; ' 



General Conments v \ ^ ^ ^ . ^ ^ 
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Perhaps the, greatestvflrustration for the reader was the inconsistency 
of the report *s (logic. • Although research (Questions were identi-^ed 
and assumptions p>reseitted, -the relationsl^ips^;^between the two were not 
clearly ^ecified>.. fact, there was inconsistency that required 
reader interpretation amoyig the study *s five assumptions, tihree 
research qiiestions,* four expectations, .and fhree null hypotheses. 



Although^ 21 Vi terns were found to h^ve been, rated' slgnifi^ntly high, 
further work is neikhed to validate these Itgms as^ desirable competen- 
cies of biology teachers?. They do represent a: very upefiil foundation 
for additional researchT.;; ' /; \ . ^ . \. , 



Finally, It is often easier to criticize another *s work than to 
generate one's own. Jthis study rip reisents a fine beginnitig to what A 
can be a 1/fery useful research proOTataj to validate biology' teacher , 
coiipetenci^ dnd then to investigate teacher appraisal i)i relation 
to those competencies. It is'hopdd that ^ this analysis inay vjcohtribute 
to. and encourage/the continuation alnd expansion 'of this lirij| of 



research. 




^0 



vak, ^bi^ph p. 
™*^jcat;ioti-" 
3. . ■ ( 
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Purpose • , / V ' » 

. ' / ' ■ • ' " ■ ' ■• •• • ■ ' ' . .a 

■ ■ ;' . * ' * . ' ' 

Because of society's expectations, girls appear to have had fewer hands- 

• • i ■■' • 

on experiences related to science learning and cognitive development.'- 

. |. . • ' r . ' ■ s 

Because of these gender-related ^differences in their experience bise, 
it was hypojthpsized that girls would be fiinctioning at a 'lower cogni- 
tive developmental level and thus less successful in solving science- 
related , problems. 



Rationale 



A. 



^As exemplified in the work of Piaget, one's TntelleGtual development is 
expected to be a funct^iori of earlier experiences. Informal descriptors 
of girls' experiences suppo.rr the assumption that their experience base 
is substantially different than that of boys. 



Research Design and Procedure 

i 

A posttest-only-no-control group design with non-random selection of 
three pairs of boys and girls at ages 9,. 11, 13 and 15 served as the 
sample. ' No treatment was involved. Each s-.tudent was asked to solve 
four problems. Based on recordings of these individual interviews, 
the stud.ents^ level of cognitive development was estimated. 



Findings 



Boys consistently performed at higher cognitive levels- than did girls. 
Observable differences in the ease with which boys manipulated mater- 
ials were noted. Boys were said to be mo riB successful in solving 
problems than were girls. . " ' ^ 



Interpretations 

Cognitive development— or its lack — was not related to IQ or school . 
achievement. Boys did better than girls becaiase of the gender-related 
social dimensions. 'Schools value "such traits as agreeability , punc- 
\uality, cooperative, neatness^ and subpissiveness Girls mor^ than 
boys display these traits in conforming to' schooling expectations — . 
and at the same time in that conformity retard their -cbgnitive develop- 
^ment. , 



ABSTRACTOR'S ANALYSIS 

In posing a question concerning a factor that may help teachers iiiq)rove 
their approach to science instruction, the author begins with a hypo- 
thesis that has grown out of her personal teaching experien^. This is 
very positive'. Relating gendei^ differences to the'social upLieU is 
useful. Although the author .suggests 'that these differences are^essen-, 
tial variables in cognitive development and problem solving, th^ study 
deals only with cognitive development and ignores both the literature 
and the analysis of the problem solving of students. 

In this exploratory non-experimental study there is an intuitive search 
to see if differences exist between boys and girls, aj-though the hypo- 
thesis suggested that the study would not "see if" but Vould demonstrate 
the transition. As hypothesized, one would have expected to find a pre- 
post design with a treatment in which a transitibn was ^ttempted and 
observations made to document its existence or lack of occurrence. The- 
author vaguely describes the sample which could consist of as few as 



three pairs of students ,(N = 6) or three pairs for each of four age 
levels (N =24). Previous experience was identified as a significant 
variable — but was not assessed in any sys^tematic way. Although prob- 
lem solving performance was identified as one dependent variable^\no 
measure or analyses werfe reported. While informative, neither the\^ 
graphs nor the report provi^de the reader with any data analysis to y 
support that the differences observed were significant. 

In this clearly written report on a topic of keen interest to science 
teachers, the reader is left with the clear impression that the dis- 
cussion section reflects the author* s opinion sinc6 no empirical data 
analyses are reported to support the conclusions. Teachers need more 
research" that is- based pn important classroom observations as tKis 
study is. But, teachers jfieed to have such questions followed by 
intelligent design, analysis, and interpretation. This study would 
be substantially improved by these three addictions. - 

• ■ ■ / ■ r - 
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Putpose ^ 

The^ study was designed to ascertain the effectiveness of integrated 
science process skill instruction on prospective* elementary teachers* 
(1) achievement of the integrated science process skills, (2) selec- 
tion of , integrated science process skill instructional objectives, 
(3) writing of |)oth integrated science process skill instructional - 
objectives and learning activities in lesson plans, and (4) attitude 
toward the use of these skills in the' classroom. A secondary purpose 
of the study was to*determ±ne the effects on the teachers of reading 
a persuasive communication as measured by the dependent variables 
already listed. Th^ persuasive article advocated the teaching of - 
integrated science processes in the elementary classroom. 

Rationale ' . \ - . ^ . 

The intent of many of thife new elementary school science curricula has 
been to develop the science process skills in children. This instruc- 
tional emphasis is also reflected in the type of science process 
skill training received by prospective elementary school teachers. 
Butts and Raun (1969), among others, have determined experimentally , 
that training inservice teachers in the basic^.science process skills 
(as defined by the Scienj^e Education Cominission 6f AAAS) had positive 
impact on the teachers* \:omp^tence in using the skills, attitude" 
toward the skills, and n^eySf the skills in classroom science acti- 
vities. However, until the present research, no one had investigated 
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the direct effects of training prospective elementary teachers in ' * 
the integrated acience. process skill's. • 

Ttfe present study was also designed to *f urther explore HUghes V j[197p) 
finding that the use of a persuasive communication about using inte-. 
grated science, process skills significantly improved the attitudes 
of .prospective elementary teachers toward teaclling science^ as a process. 

Research Design and Procedure 

procedures . The experimental design used was a s^tatic group comparison 
using three intact classes of 90 ;preservice teachers enrolled in Elemen- 
tary science methods classes. Prior to receiving one of the three* 
treatments, each student demonstrated his/her ability to wr^-te accept- 
able behavioral objectives and design adeqxiate science ^lesson plans at 
the 95 percent mastery level. Also prior to treatments, the intact 
classes were found to be statistically equivalent for ^rbal and mathe- 
mat;ics scholastic aptitude test s'cores and cumulative grade point 
average. ^ i 

The control group. Class A (N =26) received placebo instruction In con- 
tingency contrasting and mastery learning. Class B (N = 31) received 
instruction in the integrated science process skills via the integrated 
science process skill self- instructional pamphlets. Class C (N = 33) 
received the samd pamphlets plus the three-page persuasive communica- 
tion. Treatment for all classes lasted four class sessions. 

Instruction for jgroups B and C consisted of ten self-instructional pam- 
phlets developed by Okey and Fiel (1971) . Approximately eigjit hours 
were required to complete the tasks and self-tests which dealt with 
identifying variables, graph construction, relationships between varia- 
bles, data processing, analyzing investigations, constructing hypotheses 
operationally defining variables, designing investigations and experi- 
menting. The additional treatment afforded the group C subjects was a 
three-page handout which contrasted factual, conceptual, and process 
approaches to teaching science. 

> 

.... ' 0:t ■ 

~'.f CjO 



Measures ,y The four "major instruments used in the study were adminis- 
tered after the 'groups had completed the related treatment. The 
instruments included: " . 

' ' • ■ . * ' ■ 

'^1). Integrated Science Process Skill Achievement Test which 
; measured the acquisition of integrated sciei^ce process 

skills by the subjects. . Content validity aiid test reli^- 
bility were reported for this test. 

2) The Selection of Objectives Questionnaire- consisted, of a 

% . ' ^ / 'f ■ ■ ■ ■ ■ • 

randomly ordered list of I ten integrated ^^^'cience process 

obiectivels and ten science ^content objectives all relating 

to a ^unit of ^ instruction on the topic^fflants and Plant Growth 

Each subject was told that all 20' o^)§ectfves wer'e appropriate 

and they were to select any ten thatvthey felt should be 

included in a unit on plants. The;?5bi^nt: validity and 

reliability of the instrument were r^orted.. * ^ 




3) The Integrated Science Process Sk^|BBfcitud^ Measure con-- 
sisted of 30 statements to which th JE^Bfectis reponded on a 
five-category^ Likert-type scale. For exaii?)ie, a subject 
might mark strongly disagree to "I am* more interested in the 

.^number, of science facts and concepts a child remembers than 
in how well he solves science problems." The reliability of 
the instrument based on a test-retest method was reflected 
in the Pearson produ^^t-moment correlation coefficient of 0.76. 

4) Lesson Plan Objectives and Activities consisted of five 
behavioral objectives with one or more activities per objec- 
tive. The lesson plans were evaluated by counting the number 

integrated science process skill objectives and activities 
per lesson. No reliability or validity estimates were 
reported. 
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Findings — 

There were significant differences (p<.01) between means for Class A 
(30.46) with Class B (46.19) and Class A (30.46) with Class C (46.48) 
for the achievement test, with an overall F value significant beyond 
.001 level. There were significant" differences (p< .01) between means 
for Class A n(4. 19) with Class B (6.22) and Class A (4.19) with Class C 
(6.75) for selection of objectives questionnaire, with an overall F 
value significant beyond .005 level. 
'* 

There was a significant difference (p<.05) only between means ^or 
Class A (.46) with Class C (1.27) for the number \)f process skill 
objectives written in lesson plans, with an overall F value signifi- 
cant beyond the .05 level. - 

There were significant differences (p<. 05) between the ^ 

A (2.80) with Class B (4.70) and Class A (2\80) with Class C (5.00) 
for the niimber of process skill learning activities written in lesson 
plans, with an overall F value significant beyond the .01 level. \ 



Interpretations ^ 

The researcher^^con^rmed that preservice teacherrtraining is success- 
ful in promoting competence in the integrated science process skills . 
This confirmation was important since many preservice teachers in the 
control group lacked proficiency in some of the process skills. Many 
of the control group subjects- Apparently had little. previous exposure 
to science process skills in their high schodl or college science V 
courses. ' • 

Since preservice teachers who revive training in science process skills 
wrote significantly more process-oriented instructional objectives and 
activities than did their untrained peers, it was suggested that having 
teachers competent in science process skills was a first step in pro- 
viding for development of process skill acquisition by children. 
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It was also implied that training teachers in process skills will 
Increase vse in the classroom of process oriented elementary science 
curricula. It was suggested that even though the attitudes toward 
process skills were not different among groups, 'training was reqxiired 
to impleraBnt this desire to teach process skills'. The results of this 
study did not support previous studies which showed that reading of a 
persuasive communication could significantl^knfluence the attitudes 
of its readers. It was suggested that perhaps the 700-word communica- 
tion tised was not powerful enou^ to affect teacher attitudes. 



ABSTRACTOR'S ANALYSIS ^ 

The study supported the suggestiop that well-planned instructional 
packages can improve shortr-term achievement of the selected objec- 
tives. There was no attempt to measure lon^term retention. While 
the study demonstrated that achievement of process skills also 
influenced application of the knowledge in written lesson plans, no 
evidence was gathered to determine whether the preservice teachers ' 
operated differently in the, classroom as a result of the instruction. 
Previous studies found that training inservice teachers in process 
skills caused teachers to teach these skills in -the classroom science 
activities. Since preservice teachers have different concerns and 
experiences from inservice teachers, it may hot be reasonable to 
generalize f rp;a_-the previotis studies and infer that preservice sprain- 
ing of four will have an impact on actual classroom instruction. 
The major finy^g was to produce supporting evidence for planned 
instruction increasing achievement in preservice teachers. A priori 
judgment perhaps could have accurately formed this conclxision. 

• - " — ' • 

The failure of the istudy to support previous findings that a persua- 
sive communication can influence attitudes was explained by the lack 
of power of the communication. The effect of the communication was 
not measured independently from the instructional treatment. A two- 
way factoral design' with four groups would have included a treatment 
group receiving the persuasive communication treatmerit separately from 
the instructional ^treatment. Analysis. of the relationship of the 
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additional group to the other groups would indicate the relative 
effect of the persuasive comniunication. Without, the independent 
coinparison, the study could not completely 'interpret the effect 
of the persuasive "communication. 

Indices of validity and reliability were reported for all dependent 
measures except the lesson plans. The appropriateness and interpret- 
ability of the indices is questionable. The reliabilities were all ' 
based upon the test-retest method, ' where the same. it ems are, used iti 
both measures. 'With only four days between pre- and post-test, if 
is very likely that spuriously hi'gh correlations between the two 
administrations will result from a memory effect. 

The validity ^data for the achievement test was based upon the degree 
to which the nine tasks related to the nine process skills. There 
were 53 items scored for the nine tests. A more meaningful relatioAr- 
ship could have been drawn between the individual items within each 
task and the related process skills. A spuriously high correlation . 
may have resulted from the correlation of the nine tasks with the 
respective process skills. 

The validity of the objective selection questionnaire was established 
by the ability of experts to select process oriented objectives . The 
instrument was administere'd and scored according to directions that ^ 
ask the respondent to select those objectives which are most important 
to teach . The instructions for the subjects suggested a .more value- ' 
oriented measure than did the validation procedure.- The validation, 
proceduire and the use of the instrument should be directed at measur- 
ing the same trait. 

Na reliability or validity was reported for the rating of the lesson 
plans or the ntiiiber of process objectives and process oriented activi- 
ties. It was reported that the lesson plan was not an instrument per 
se. Interrater reliability and concurrent validity methods might have 
been used to establish these indices . J 
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The overall group comparisons were reported at levels of significance 
varying from p<,001 to p<..10. The Neuman Kexils test of the pair^ 
wise dt>mparison of meaife was performed for those overall analyses 
significant at p<V05.*Mt was suggested for attitudes that evidence 
Qf a trend existed for treatment groups having higher means when the 
level of significance was p< .10. If the level of significance for 
rejection of the null hypothesis was set at p< .05, then it wasn* t - . 
reported as such, and any overall analysis which failed to meet- the 
pre-established criterion indicates no systematic differences between 
the groups. 

A univariate anin/a was used Vhen five dependant variables were analyzed. 
When a series of imtvariate analyses are performed in one analysis, the 
probability that one of the analyses will be significaat by chance alone 
is increased. This possibility's a limitation of the analysis proce- 
dure selected. 

The analysis of the lesson plan was based upon the ntmiber of written 
process oriented objectives. Although these results were found to be 
significant, it was difficult to interpret mean score data. When 
inspecting the number of objectives, the treatment group with the 
highest score was 1.27 out of a ]^ossible score of 5. Does 25.4 percent 
process oriented objectives in a written lesson plan suggest compe- 
tency^? , - * 

/• ' . ' 
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Purpose 

The purpose- of the author's experiment was to develop and employ 
-for the teaching of seventh grade biology. TJj^s^model included 
sis on individualized instinxctlon using a nrulti-media approach in order 
J to provide for a ioaximiim amount of learning regardless of. the student, s 
cultural background. The author hypothesizes that a program consisting 
of less teacher-centered instruction with a "mastery learning" concept 
effects greater cognitive and affective gains on the part of the student. 



8 

Rationale 

The author states that due to the nature of settlement throughout Israel, 
the Ministry of Education in 1964 proposed educational reform based upon., 
the needs of students from all socio-economic levels. The Ministry of 
Education recognized that the educational needs of that segment of 
society deemed culturally deprived were not being met. The en^hasis 
of the author's model was an attempt to effect a better learding flllieu 
for these deprived students. This model was, therefore ^^^^ attempt to 
provide a pragmatic interpretation to learning and, teaching theory with 
the production and implementation of curriculum end educational mater- 
ials. Twelve teaching strategies and 12 pedagogical techniques were 
drawn from literature on the teaching of culturally deprived students; 
these strategies and techniques then served as the foundation for the 
author's model. 
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Research Design and Procedure ^ 

lii order to inmlement the 12 strategies and tfechni^ues for teaching 
culturally derived students, a pilot study and three subsequent revi- 
sions were conducted in several seventh grade biology classes as 
summarized in Table 1. ^ /.% 

- ' Table 1 \' : 

' J*. . ' • 
A Summary of Kaplan* s Treatments 



Group 



2 
3 



Date 



1970- 71 

1971- 72 



Classes Schools 



Pilot Not stated 
1 1969 



Small 
groups 

6 



5 Experi- 
mental - 

4 Control 



2 
4 



1 

1 



Number of 
Students 



Units 



Not stated Not'stated (Five 
-X five-lesson units) 

Not stat^ Two units of a pro- 
^ * jected 8-unit sequence 

weife. constructed and 
V. employed — 

^ A. Waper as a Habitats 
B. The Organism and 
Its Environment 

Not, stated Npt stated 

. N = 154 Not stated 



N 



251 



Because one of the major concerns of this study w^s .to deyise a curricu- 
lum which would meet the needs of a diverse Israeli society, the schools 
involved •in the program' .were selected to reflect this diyeAity in the 
ethnic and economic backgrounds of their students. , In a preceding arti- 
cle appearing in the same journal which outlines the theoretical 
foundation for his model, Kaplan also categorized, students into the 
following intelligence groups: . . 
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1. Intellectually gifted (more than one S.Dv above the mean 
IQ score) ' c 

2. Average 

3. Below average (within one S.D. below tli^ mean) \ ' !; 

4. Low performance (beyond one S.D. below the mean) , 
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A xurriculunij therefore, was dei^lgned to help all: students (wit the 
'exception of the lowest group), .but special emphasis was given to the , 
below average group designated as "gifted culturally deprived." ^,The 
author recognized deficiencies in this particular group including a 

low reading comprehension, a; poor^ learning and reaspiiLing patterfi, a • 

* '\ " ■ ' * 

rigidity in the face of change, aifd a lack of motivation and self- 
discipline in relation to ac^deinic\ goals and study habits. The , curric- 
ulum, therefore, was aimed. at ^is Uow'average group^^th enrichment 
activities available for the fa's ter\ students; The author hypothesized 
that statistically .significant gain -scores would he attained' by this , 
target g^oup as a result of his proppsed curriculum innovations.. The 
course of study followed in this expelrimfent was part of a sequential 
junior high program which included aquatic zooecology on the seventh 
grade level. A model curriculum was developed which consisted of ^ five 
lessons within each unit: ; " ^ 



A teabher-directed didactic introduction or discussipn period 



< 



An open-ended laboratory experience . " 

. ■■ * 

An analysis— a "competency measure" and a programmed lesson of 
core concepts - 

An analysis^an additional time period for slower students to 
complete the core material or: an enrichment period for faster 
students 

A ufcLt test— a test with maximum score possible being 80 per- 
cent for those completing only the core program, and addi- 
tional points being an incentive for those students invoJ.ved 
and tested on the enrichment lessons. 



The unit test was aimed at placing the students under a minimum amount 
of pressure and at allowing a maximum amountj^^f encouragement. Students 
were told that "mastery learning" could be achieved through completion 
of only the core lessons of each uni^. 

As a result of the model being aimed at the {gifted culturally deprived, 
the lecture method was deemed inappropriate. Since this was the pre- 
dominant method employed by Israeli teacher^, child-centered teaching 
methods had to be taught to those teachers involved in the experiment. 
> Teacher !s Guide was also provided as an additional resource. 
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FlndlhgB ; . . .' . , " ' ^ '■ j 

The author 'reported achievement res.ults for only hil^ 19^1-72^tudy. 
These results deslt* primarily with ^he difference in gain scutes between 
pre- and post-achievement tests. Th'epe tests covered knowledge of basic 
biological concepts apptopriate for the seventh grade curricuXujp through- 
out Israeli schodls. In the 1971-72 ^*tudy, Kaplan had an expej?imentalf 
groupi, of 154 students and a control grpiip of 251 students . In/f?ompar- . 
ing the results of the increase in gaiff scores ;between the pre-- . and. 
post-tests of tsiiese two groups, KaplanCifeported .that the experimental 
groups attained a higher percei^age of increment of improvement than 
did the control group. This increment l^s true "in three subtests: 
basic knowledge, comprehension J?fiihd hig* 



In addition to the achievement • ^Agtitudes Towards Biology test^ 

^ a modified version 'of the NALSMAl^epor^lest of attitudes towards mathe- 
matics, was employed. This test .j^nsisC/d of twelve areas. Using an .' 
analysis of variance between the contro^ a^^^ scores on 

this test, three areas were foun4-^signi% at the' 0.05 level in 

favor-of the experimental group. i 

V , / - * . . ; -. . , ■ ■ 

. • o 6. b . -'**-, 

' Interpretation 




ERIC 



Kaplan infers that the gifted .ciultural^ deVrived students can achieve 
"mastery learning" if teachj|fs , are. trained to utilize a more student^ 
orient ed^ approach to teachinl./^^S^ Infers that the gifted cul^ti^-^ 
ally depr|prfed students achieve k leVel of mastery of subject matter, 
only if they are allowed a. flexibla^amount of time for learning, y 



ABSTRACTOR'S ANALYSIS 

While the authot reports significant gains achieved, especially for 
his 1971r-72 research, several shortcomings are inherent in the report- 
ing of his study. This deficiency dn reporting can be seen in the 
following. 

. . ' 29 X 
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1. ' The reader is not given a full summary of each year's study; 

comparisons among the various investigations are lacking. 

2. The article is not presented in a scientifically-oriented 
format; e.g*, the purpose of thia study is found under the 
results category. Therefore, only througjh the reader's 
reorganization of the material can a full understanding 
of the proje,ct and its results be gained and understood. 

3. * The "author luakes several generalizations without citing 

specific supporting da^ta;. e.g. , he not only fails to men- 
tion the twelve sub- topics of the Attitudes Toward. Biology 
test/ hut he also neglects to specifically state which three 
categories he found significant. 

4. Some of Kaplan Is tables do not ccrfi tain sufficient informa- 
tion; e.g., he defines four groups of students based upon IQ 
in his first article, but he fails to statistically analyze 
any data in relation to this method of grouping. 

, ■ . • ' y , 

5. The author does not describe in any great detail the length 
or duration of each lesson and/or the content of each unit; 
e.g., Kaplan neither specifically state^rthe units employed 

' for his 1970-71 or his 197.1-72 research nor tells how long 
the units were studied. 

6. The author assumes , the reader's understanding that the con- 
trol group involved the traditional lecture method and the 
traditional curriculum techniques; no information whatsoever 
is given. ^ 



Therefore, the author's lack of -reporting his investigation in a. 
scientifically-oriented manner- detracts from the merits of his endeavor. 

Whil^ Kaplan states in his article that his main objective is to docu- . 
ment the amount of significant gain among the gifted culturally 
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deprived students, his research does not show this factof^adequately 
through his statistical design. Instead, the findings reported for. 
1971-72 are those for all intellectual levels and not for just the 
gifted culturally deprived. Furthermore, his documentation does not 
indicate what percentage of the 154 students in the experimeWtal group 
were considered in this category; therefore, the gains he reports 
(Table 6) would be for all intellectual groups and not tor just this 
select group. 

In contrast, a more adequate statistical design could have involved 
a comparison of the experimental and the control treatments for each 
of Kaplan's four intelligence groups. Using pre- and post-test gain 
scores, analysis of variance could have been performed between the 
groups (1 and 2, 1 and 3, 1 and 4, 2 and 3, 2 and 4, and 3^ and 4). 
Further analysis could have been performed based upon cultural 
patterns; e.g., students ftom Western European and American back- 
grounds could have been compared with those 'of Asian-African back- 
grounds for each ability group. Figure 1 summarizes this suggested 
research design. . 

In addition to the deficiencies inherent in his research design, Kaplan's 
testing procedures are questionable since he does not justify what he 
does. This point is illustrated in his 1969 study when he reports 
administering an achievement test after only one week under his pro- 
grato (see Table 5). A more Ipgical choice for administering the test 
would have been after the entire treatment had been given. His question-, 
able testing procedures are also Illustrated in his use of a standardized 
test for his 1971-72 research. It would have been more appropriate for 
him to have constructed his own test 'or to have located 'one which could 
have assessed the significance of his method. The need for a new type 
of testing which would be an integral part of any given curriculum and 
the implementation of this type of testing concept is discussed in* 
relation to Israeli schools by Tamir (1978). ^ 

Another area of concern is the author's failure to show the relation- 
ship of his investigation to other research in this field. Although 
other studies dealing with culturally deprived students are mentioned j 
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in general, no specific references are employed for comparison. This 
deficiency is paramount because of the need for similar programs in 
the United States. ---^ — — 

While obvious deficiencies are prevalent in Kaplan* s reporting and 
research design, his model is valid. This model is an objective , 
treatment of subject matter administered within the biological 
sciences. It would have been appropriate for Kaplan to have made 
recommendations for the implementation of this model in other sub- 
ject areas. Since the education of the culttirally deprived is a 
difficult problem at all levels of 'education, Kaplan* s model could 
be employed as a teaching method to help every student achieve 
"magtery learning." ' ' - 

■ REFERENCES \ . 
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Nelson, Miles A, ••Evaluation of a Cooperating Teacher Training 

Prografa/^ Science Education , 59(4) :505-515, 1975. i ' 

. Descriptors — ^Cooperating Teachers; Educational Research; 
*Instruction; Science Education; Secondary Education; 
*Secondary School Science; *Student Teachers; *Teachef 
Supervision; Teaching Methods " ^ 

Expanded Abstract and Analysis Prepared Especially for I.S.E. by Hans 
0. Andersen, Indiana University. 



Purpose 

The writer's purpose, was to describe a training program for cooperating 
teachers w)iich provided the participants with specific supervisory 
skills and to explore the program^s effects on a novice •s practicum 
experiences Specifically, the investigator sought an answer- to the 
following question: Is there a correlation between the behaviors a 
cooperating teacher has acquired in a^ training program and the class- 
room performance of his assigned student teacher? ^ 

* Rationale 

The author noted that numerous articles have been written that describe 
how to train a cooperating teacher but that few Invesf^ators have 
attempted to relate the training proved cooperating tethers to 
changes in the behavior of student teachers. More specif ic^ly, arti- 
cles describing the influence of the cooperating teacher in the attitude 
and teaching style of the student teacher are available but very few of 
. these articles relate what the cooperating teacher does consciously to 
modify the behavior^ f a practice teacher to changes that are later 
evidenced. , . 

Research Design and Procedure 

Six two-hour workshops were provided for participating cooperating 
teachers. The objectives for these workshops were: 
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a. To identify beginning science teachers* strengths and weak- 
nesses in the area of planning, questioning techniques and . 
student involvement • 

b. To learn how to communicate, to the beginning teacher, 
identified strengths and weaknesses. 

c. To plan experiences aimed at eliminating observed weaknesses 
in student teacher behavior. 

The purposes for each workshop are here delineated. 

» ■ 
Session 1 

Purpose — Demonstrate the effect of focusing on a single aspect 
of a lesson and critiquing it. , 

Action — The cooperating teachers were shown a 10-minute micro- 
teaching tape^of a novice, a post lesson critique focused on a single 
teaching skill, and the reteach tape. In the discussion that followed 
viewing two cycles of teach, commentary and reteach, the cooperating 
teachers concluded that a dramatic change in novice teaching behavior 
could result from this type of effort. 

Sessions 2 and 3 

Purpose — The cooperating teachers viewed lessons , practiced iden- 
tifying weaknesses in a student teacher^s p'lanning, and devised 
experiences whlc^ would provi% the practice needed to eliminate the 
undesii^ed behaviors. 

Action — The cooperating teachers were shown examples of beginning 
teachers who a) planned and did not plan for student involvement; b) . 
j^tacticed and did not practice a demonstration before using it in 
class; and c) did and did not use performance objectives in their 
planning. The discussion following each segment focused on the differ 
ences; in performance of students who did and did not plan. Then 
participants- were led to a discussion of tactics they could use to 
eliminate these weaknesses. 



Session 4 



JPurpose — To detect weaknesses in a student teacher's questioning 
techniques and plan tactics to eliminate quiestioning weaknesses. 

Action — The investigator began the session with an examination or 
questioning types and a discussion of the appropriate use of questions. 
A list of questions classified by type Wth a statement regarding an* 
appropriate use of the questions was distributed to facilitate dis- 
cussion. Video-taped lessons of beginning teachers were shown and 
analyzed. 



Session 5 ^ • 

Purposes -Examining techniques used to get student involvement. 



Action — Video-tapes illusl^ating successftCT and msuccessful 
attempts to stinjulate student involvement in lessons were shown to ' 
stimulate a discussion of novice e^rrors and tactics cooperating teachers 
could use to help the novice eliminate the errors. 

Sessions 5 and 6 ^ 
If 

Purpose — Examine the purp*e for and handling of the critique 
session. 

^ ' Action- rThe investigator provided the cooperating teachers a model 
of the critiquing ^ssion and research data supporting his claim that 
the purpose for the critique was to get the novice involved in discus- 
sing one or two positive or negative aspects of a lesson he/she had 
just taught and planning how to improve his/her next presentation. 
Video-tapes of criti^e sessions were also presented and analyzed. 

Thirty-nine (39) cooperating teachers, 19 of whom had conpleted the 
training sessions, and 52 beginning teachers participated in this 
study. The novices were randomly assigned to cooperating teachers 
in their respective disciplines. 



. To determine if cooperating teachers used the methods presented in the 
workshop, . a 26-item questionnaire was sent to each novice. The ques- 
tionnaire directed the novice to rate the frequency of the cooperating 
teadifer's comments (0-4 scale) relative to planning, questioning tech- 
niques, student involvement and the cooperating teacher* s supervisory 
style. The questionnaire contained items classified as follows: 

6 questions on planning comments 

6 questions on questioning techniques 

7 questions on student involvement comments 
7 questions on critiquing style 

Ratings were totaled wltftin each area and used as the, independent varia 
ble.-^2x2x2 factorial design which had as factors; Replication, 
first or second semester; type of experience, internship^ or student 
teachJ^ng; and Cooperating teacher .training, yes* or no. Scheffe's 
approximation was used to correct for unequal cells.. 

To determine the effects the supervision had on the novice, trained ^ 
judges who had never seen the novice teach were used to rate preprac- 
ticum and post practicum video-tapes. The judges* reliability (.90) in 
using a low- inference observation instrument of the checklist variety . 
was established. The stepwise multiple regression technique used to 
analyze the data is well described by the author. 

Findings 

1. Irrespective of replication or type of experience, the trained 
cooperating teachers were rated by the novice as making more 
comments about the novices, questioning techniques, and student 
involvement. The differences were significant at the .05 level. 
The differences for planning connnenta^^^^ere^ot significant 'but 
the trained cooperating teachers were favored. The analysis of 
the data on critique style also significantly favored the trained 
group. In general, an interpretation of the data supported the 
conclusion that the trained teachers performed the supervisory 
job better as supervision was defined by the model. 
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2, The data seem to support the claim that the frequency of comments 
^ jmde by the cooperating teacher which are related to the skills 
developed in the training program are correlated with the begin- 
ning teacher *s perfoniiance. The magnitude and direction of the 
changes were purposely not discussed by the investigator. 



Interpretations 

•The investigator indicated that the short six-hour training program^ 
had an effect on the teacher's style of supervision. While avoiding 
statements on magnitude and direction, the investigator reported 
correlations between super^^isory behavior and novice post practicum 
behavior. 

*■ . ^ 

ABSTRACTOR'S ANALYSIS 

That we should be accountable is a concept that we all should enfcrace, 
Taxpayers and students have placed faith (and money) in us as persons 
who are capable of preparing teachers. Yet, as Nelson points out, 
there is very little hard evidence available supporting our claim 
tha^ we are able to prepare teachers. Yes, most of us have testimon- 
ials and many of us have observed our students doing what we and many 
others think is a credible job. But, as Nelson undoiibtedly had to 
apnclude, hard data support is scarce and hard to obtain. 

Nelson's effort to train cooperating teachers is most noteworthy and 
absolutely essential. However, one must wonder if a six-hour s'ession 
can produce the results he had hoped to obtain. Two questions are 
unanswered. They are: 1) To what extent did the trained cooperating 
teachers become committed to the model and conscientiously implement 
it in their critiques? How much enthusiasm, and how much time did 
they devote to the .task? ^ 2) To what extent did untrained cooperating 
teachers employ elements, or^^ll, of Nelson's model? The statistics 
reveal a difference between the trained and untrained but the magni- 
tude of the difference cannot be "practically estimated, and the 



untrained coiiLd well have been partially trained or, because of other 
factors, oriented toward beliavlors described in the; model. 

I have used similar techniques^ as^ those described by Nelson, As did 
Melson, I pieced together the techniques from a variety of research 
sources and philosophical statements. I believe the model is sound 
but, to test its soxmdness I would have to . develop testing procedures 
that most of us avoid like the plague. That is, I would have to 
teach Nelson's model to one group, the antithesis of Nelson's model' 
to another group of cooperating teachers. Then I would hp.ve to 
determine that the cooperatitig teachers were handling their critiques 
in a manner consistent with the models. TAkn 1 could coiipa:re changes 
made by the student teachers that could be. attributed to the critique 
process. (This design could be improved if we could identify those 
students whose behaviors are immune to either treatment.) 

' ^^v . . . 

I doubt if Nelson 'iiefeds any suggestions on how his research might 

have been impr9ve(E^^lIis list of desired and desirable changes prob- 

• * 
ably exceeds mine.' Hence, would^reieor^to^ .it^pjnpli^ 

excellent study performed in a naturalistic setting in which the 
investigator attempted to control as many variables as possible. It 
is obvious that the data were carefully collected and analyzed. And 
it is obvious that Nelson was very careful and conservative in stat- 
ing conclusions and implications of his effort. He had to bel 

Ifelson's descriptions of the workshop sessions were particularly 
excellent. I believe I could replicate his effort in spite of the 
fact that his descriptions are exceedingly ^brief. This brings me 
to another point. I assume I could obtain a more elaborate descrip- 
tion of the workshops from Nelson, but that is not mentioned any- 
where. Also, are the video-tapes available for rent or lease, or. to 
copy? Does the investigator, himself, feel that a replication or "a 
replication with modification would be desirable? If so,- under what 
conditions? 

In way of criticism, would a description of the trained and untrained 
cooperating teachers be of use to persons reading the report? How 
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.were the cooperating- teachers obtaiped? Were there differernces 
between the trained and tintrained cooperating teachers that could 
account for noted variants? Was Nelson free to i^ke any^i^ch 
comparisons and report them in the literature? ^ 

In concltision, permit me to offer my opinion- that Nelson's effort 
was timely, it was apparently well implemented, .and it was wpH 
reported. I also suspect that it was underfunded and that N<^1soti. 
was unable to control aspects of the study he would have lik^d to 
have controlled. 




Seymour, Lowell A. and Lawrence P. Padberg. "The Relative Effectiveness 
of Group and Individual Settings in a Simulated Problem-Sdlviag .Game.." 
Science Education , 59(3) :297-304, 1975. 

Descriptors — *Biology; Educational Research; *Group Activities; 
Individual Activities; ^Instruction; ^Problem Solving; Science 
Education; Secondary Education; ^Secondary School Science 

Expanded Abstract and Analysis Prepared Especially for I.S.E. by Lynn W. 
Glass, lo\m State University, 

Purpose 

This research was designed to investigate two aspects of group work. A 
modification of a simulated problem-solving game devised by Jay Hall was 
used to compar^^he relative effectiveness of individxial work versus group 
work and group work alone versus group work following individual work. 

Stated as directional hypotheses, the investigators sougjit to determine 
(1) whether students working In groups will score better (lower) as a ^ 
group than t^ average score of students working individually, and (2) 
whether students working in groups, with the previous experience of indi- 
vidually attacking the problem, will score better (lower) than students 
working in groups without such prior individual work. 

^ .... , . 

Rat ionale 

The value of groups for developing attitudinal qualities, motivation, 
social interaction skills, in-depth understanding, greater retention of 
Information gained, etc. has been accepted either intuitively or empiri- 
cally by large numbers of persons.' The authors cite several studies that 
provide support for various values of group work. The authors of this 
study cite a concern of theirs that many teachers are misinterpreting 
the results of the "Lost on the Moon" exercise as evidence for the super- 
iority of group work over individual work. Hence, the rationale for this 
study was to design an investigation that would study the relative' effec- 
tiveness of Individual work versus group work and individual work versus 
an individual-group sequence when applied to the successful completion of 



a problem-solving task. This study does not depend on any single prior 
piede of research for^ a basis; It dqes, however, contribute to and build 
upon-a -large cluster of research that deals with values of group work. 

rt • * - r . . 

Research Design and Procedure 

Thirty-two heterogeneously griped by ability, coeducational, tenth 'grade 
biology classes taught by 15 teachers were used to obtain data. Each class' 
was divided randomly into two teams of 14 students each. On the fourth 
class period of the school year team No. 1 completed the "Lost on |hf Moon" 
exercise first as individuals and then in groups of three ^r four ^^tudents. 
Students in team No. 2 completed the exercise first in groups and jihen 
individually. Data are reported by class and by team as mean indi^ioual 
scores and mean group scores. This counterbalanced design can be.|:epre- 
sen ted diagrarametically as thus: §^ 



X,0 X 0 
i g 



X 0 X,0 

•g . i 



when i represents completing the exercise as individuals and g, 
represents completing the exercise in groups. ^ 

■ ' ■ tr' 

In the "Lost on the Moon" exercise, students are directed to rank from most 
important to least important fifteen items available to a crewpof astro- 
nauts stranded oiiv the moon. Scores are calculated jby adding tpe absolute 
dif ferencesvbetWeen proposed rankings by the students and ranjc^ngs ^provided 
by NASA. Low scores, indicating least difference between proposed '.rankings 
and NASA rankings, are best; scores can range from 0 to 112. 



Findings , 

A summary' of the data quickly demonstrates an apparent advantage of group 
work over individual work. ' i ' , 
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Team No. 1 Team No. 2 

(Individtial-Grpup Sequence) (Group- Individual Sequence) 

• Individual Scores Group Scores 

Mean 39.9 " . > ' \ Mean = 33.4 .\ 

Median 39.0 Median = 34.0 

Grqup Scores Individual Scores 

Mean = 31.2 . Mean = 34l4 

Median = 30.5 © . Median = 34.0 

The first hypothesis conq)ares the team No. ;2S^oup^ scotes to the team 
No. 1 individual scores. The results of the median test indicate that 
these two sets of scores differ in central tendencies.. The fiist hypo- 
thesis is supported, students working in groups perform better than 
students working alone. " 

The second hypothesis compares the team No I 1 group scores to the team 
No. 2 group scores. The median test was used to test the difference in 
central tendencies of these two sets of scores. The second hypothesis, 
that students working in groups with prior individual experience will 
perform better than students working In groups without prior individual, 
experience, was not supported. 



In t erpr e t at ions > 

The authors interpret the results of their study to support the use of 
small groups rather than individuals in simulated problem-solving activi- 
ties. If the use of additional class time is not to be considered detri- 
mental to some other aspect of Instruction, then the individual-groups 
sequence can be interpreted as superior to the use of groups alone. Both 
of these findings were anticipated by the authors since students working 
in a group have the advantage of several viewpoint^ and sets of background 
knowledge and skills; further, students ln4he individual-group sequence 
had more time to consider the problem and had an opportunity to formalize 
their own ideas regarding the problem before being subjected to the 
influence of other students' ideas. 
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ABSTRACTOR'S ANALYSIS 



. This reviewer finds the article to be an important contribution to the 
, literatiire. MJndoubtedly it will find more value among practitioners 
•4ggklng to find ways to teach their learners more effectively than it 
will among researchers trying to build a model of human learning. The 
article can be read and interpreted easily and uses statistical tech- . 
niques that should be understood by a very wide spectrum of readers. 

The .authors chose to use the median test to determine if the two independ- 
ent populations differed in central ' tendencies . A much more powerful test'- 
would have been the iMLann-^fliitney U test. More of the^^ information in the 
data is used since the Mann-Whitney U considers the rank value of each 
score rather than simply its location wj,th respect to the combined median.:- 
Using the information presented by the authors a probability of error equal 
to 0.06 can be calculated for the second hypothesis rather than 0.15 value 
arrived at with the median test. This test would have provided the authors 
with more support when 'thej^ interpreted the individual-group sequence to 
have some advmitage '.over grb^p,w0rl;:^$ 

Although data collection procedtirea appear' to have been sound, it is 
unknown whether classroom directions were standardized with respect to 
administering' the "Lost on the Moon" e:§:ercise. For example, were all 
teams of students given the same amount of encouragement; when aisked to 
do the exercise the second time? How were "Why do we have to do the 
exercise again?" questions handled? 

A change in the article which would permit future researcher^ to replicate 
the study would bfi a short explanation of how the original "Lost on the 
Moon" exercise was modified for this research. 

Discussion of possible data comparisons that do not contribute^i^to the 
purpose of the study and are not made Tlrf-thin the study tend to distract 
the reader from the main thesis of the authors. 




Shymansky, James A.; John Penlck; Ronald G. Good; and Charles €• 

Matthews. ''Using Macroanalytic .Techniques to Study Teacher . '^ 
Behavior Patterns." Journal of Research in Science Teaching , 
12(3): 221-227, 1975. . * ^ 

Descriptors — *Behavioif Patterns; ^Classroom ObseryatJ-og-^Re^ 
niques; *pata Analysis; Educational Research; lnteT^^)i^> 
■ ■ • : Process Analysis; Measurement Techniques;' iScience J||q^ 
• *Teacher Behavior . " 

Expanded Abstract and Analysis Prepared Especially 
Thomas P. Evans, Oregon State University. 



Purpose \ J 

* ■ ■ • * . ' ■' 

■; . . ^ . • ^ :,.t. ' ■■ • ; \ 

The purpose ;of the investigation was to develop a modified version of 
Campbell's rtacroanaly tic technique and to .determine the effectiveness 
of the modified technique in identifying hew lonig-t^erm patterns^ of 
teacher behavior. 



.Rationale 



Bi'e ^Investigation was an extension aiid application of ideas presented 
by e in a study in which he developed and utilized a 

maclirb^iiA^ technique for analyzing teacher classroom behavioral 
da t^ obtained through systematic observation. of classroom inter- 
action. . » 

The following are assumptions that seem to be inherent in the study 
but were not stated as assumptions by the researchers: 

1. Macroanalytic techniques for analyzing classroom observa- 
tional data are superior to matrix analysis, because they 
preserve longer sequences of behavior, utilize greater 
amounts of coded obseryatiohal diata, and provide grater 
potential for identifying and improving instructional 
strategies, r . • • 

2. Predominant classroom behavior patterns are best * identi- 
fied by analytic techniques that utilize the maximal amouiit 



of coded observationar data and collapse all repe^titive 
'behaviors within \a given.tiine duration into single units*, 
reflecting sequences of different behavior.. 

Research Design and Procedure . 

>servational data were obtained by coding the classroom behavior of 
fifth. grade science teacher for approximately 32 minutes utilizing 
the SCAS Classroom Interaction Categories-Teacher Behaviors (1971). 
The SCAS system contained 18 categories of teacher behavior. 
Observations were coded every three seconds unless there was a change 
in behavior within the three-second interval. When a change occurred, 
it was coded. The resulting 770 observational tallies were analyzed- 
using Campbell* s five-tally macroanalytic technique (1973) and a modi- 
fied version of the technique (hereafter referred to as MACROanalysis) 

The macroanalytic technique developed by Campbell involved the organi- 
zation of observational datia into units, each consisting of five 
sequential tallies of behavior. If, for example, a 30- second segment 
of teacher behavior was coded as BBBADDAABB,. ^ macroanalysis of the 
behaviors using the Campbell five-tally ^technique would result in the 
following patterns. of behavior: BBBAD, BBADD, BADDA, ADDAA, DDAAB, 
and DAABB. Since the observation data^were coded in three-second 
intervals, each of the resulting patterns described 15' consecutive 
seconds of behavior. 

MACROanalysis was developed by modifying the Campbell macroanalytic 
technique. The modified version organized coded observational data 
into five-tally patterns, but it collapsed all uninterrupted chains 
of repetitive behaviors into single units; i.e., a series of cdded 
behaylofs such as ABAAACD would be^reduced to ABACD. Applying 
MACROanalysis to the same 30 seconds of coded behavior previously 
analyzed using the Campbell technique (BBBADDAABB) would result in 
one pattern, BADAB, rather than six. The resulting pattern was 
broader in nature in that it reflected a sequence of different 
behaviors over a longer interval of time. - 
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Each set of behavior patterns obtained by subjecting the coded obser- 
vational data to both the macroanalytic and MACROanalytic techniques 
was ranked based on the - number 'of times each sequence of behavior 
occurred in the coded observational data. The i^ercentage represented 
by each sequence of behaviors based oh the total number of identified 
behavior patterns-was calculated for each analytic technique* Visual 
comparisons were made between the rankings, and the nonparametric Test 
for Significance of Differences Between Two Proportions was used to 
determine if significant differencfes existed" between percentages of 
patterns ranked 1,2,3 and 4 in the MACROanalysis and the percentage 
of similar pat'tems obtained through macroanalysis. 

Findings 

■ * ■ 

The major findings reported by the researchers follow: 

1. analysis Utilizing Campbell *s macroanaly tic technique revealed 
a total of 767 behavior patterns, 208 of which were different; 

■ . . ^* 

2. analysis utilizing the MACROanalytic technique revealed a 
total of 441 behavior patterns. 111 of which were different; 

3. only folir of the 25 most frequent behavior patterns identi- 
fied by each type of macroanalytic technique were common to 
both analyses; 

4. the four common patterns were ranked 1,2,3 and 4 in MACRO- 
* analysis and 2,7,15 and 18 in Campbell *smacroanalysis; 

0 ■ ■ . • 

5. these four patterns accounted for approximately 33 percent 
of the total number of patterns identified using MACROanaly- 

— sis and 10 percent of the total number of patterns identified 
using Campbell* s technique; 

6. the percentage of time that each of these four patterns 
appeared in MACROanalysis was shown to be significantly 
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greater than the percentage of time they appeared utilizing 
Campbell's macroanalysis; 

7. nineteen of the remaining 21 behavior patterns in the top 
25 identified utilizing MACROanalysis did not appear in the 
50 most frecjuent patterns identified by Campbell* s macro- 
analytic technique; 

8. six of the remaining 21 behavior patterns in the top 25 
using the MACROanalytic technique did not appear in any of 
the 208 different pat terns identified, using Campbell's macro- 
analytic technique; ' * • - • 

9. MACROanalysis revealed 51 behavior patterns not found using 

Campbell^s macroanalysis; and 

^ ' % 

10. a summary of the data contained in the individual SCAS cate- 
gories revealed that„ categories S2 (observes student behavior 
but does not respond)/ S7 (asks questions which do not tell 
students what to do), and S3 (accepts student behavior with- 
out evaluation) were the predominant teacher behaviors with 
frequencies of 466, 161, ^d 123, respectively. 



Interpretations - 

♦ 

^ b ■ ■ 

The following statements summarize the conclusions, inferences, and 
implications that the researchers drew from the findings: 

1. MACROanalysis had advantages over macroanalysis because of 
its greater efficiency and manageability and its increased 
potential for identifying broader behavior pattern^ over 
longer intervals of time; 

2. failure of the MACROanalytic technique to include series of 
repetitive behaviors was not critical because of the nature 
of the lost information and the ease by which the frequency 
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of each individual category of behavior and its percentage 

of the total number of observed behaviors could be retrieved; ^ 

3, MACROanalysis has a great deal of potential for having an 
Impact on research and the training aspects of education; 

and" ~ ~ 

t ■ * . ' ' , • • . 

4. teacher behavior patterns which characterize and best facil- ^ 

Itate the attainment of individual science program goals 
could be identified utilizing MACR0ana3?ysrs: the technique ' , 
appeared to have a great deal of potential for defining 
teacher effectiveness at all levels. 

ABSTRACTOR'S ANALYSIS ^ 

The investigators in this study are to be commended on their simple but 
imaginative ideas for analyzing classroom observational data. The 
assertion that they made regarding the lack of advances in a n a l ytic tech- 
niques for observational data other than matrix analysis is unforttmately 
true. The first AETS Yearbook, A Review of Research on Teacher Behavior 
(Baizer, Evans, and Blosser, 1973)\ revealed that research involving 
systematic observation of science classroom behavior increased dramati- 
cally in the late 1960s arid early 70s, but most if not all of the atten- ^ 
tion was directed toward development, modification and application of 
observation instruments. Certainly, none was devoted to new analytical 
techniques for analyzing observational data. In recent years the. number 
of studies involving systematic observation of science classroom 
behavior appears to be declining. Many reasons could be given for^^i. v 
this decline, but a portion of the problem is diijectly related to the 
lack of further advances ijo. analytic techniques. MACROanalysis repre- 
sents an attempt to develop and apply a new technique for analyzing 
coded observational data. The real contribution of '^the technique, 
despite the overly optimistic views of the re^^rchers concerning its 
potential for identify ingj teacher effectiveness, may be its potential 
for generating a renewed interest in systematic obi§ervation of science 

■ y ■ ' ■ ' \ ' ' 
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classroom behavior. Further, it builds on the existing ideas presented 
by Campbell and could, along with Campbell' s macroanalysis, serve as a 
^springboard for engendef'ing additional analytic techniques for examlh-f 
ing classroom observational data. 

-Both-tW- r esearch~and-r esearch -JceportL. would_have_b een_greatly_i^^ 
if the researchers had avoided what appear to be discrepancies in the 
data, if they had not endedf the report with conclusions that present 
the new technique a potential' analytic panacea for Identifying, 
effective classroom practices and science teacher behavior, if they 
had not based thje investigation on a questionable assumption, and if 
they had been more precise and consistent in their deflation and 
comparison of the nature of the behavior patterns identified through 
MACROanalysis and macroanalysis. Each of these points^ is discussed 
separately arid more completely in the following paragraphs . '\ , 

Several minor discrepancies in the data were identified. First, the 

researchers reported that 770 observational tallies were analyzed with . 

Canqpbell's macroanalytic technique,^r^ulting in 767 five-tally ^ - 

patternis of behavior. The analysis should have resulted in 766 . 

^.patterns of behavior. Secondly, a table summarizing the frequencies - 
i- ' ■ 

of behaviors revealed 782, and not 770, tallies of observational data 

when they were total ei^ the reviewet. A total was not presented in. 

the table. Third, the summary table reported that the S3 category 

"(observes student behavior but does not respond) had a frequency of 

466, representing 58 percent of the total behaviors. The .percentage 

should have been 60 percent if the total number tallies was 782 or 

61 perpent if the total tallies was 770. Such discrepancies were not 

serious in that they, did not significantly affect the conclusions. 

They were, nonetheless, confusing arid did not ensure confidence in 

the accuracy of the remaining data and analyses. 

Some of the conclusions concerning the potential of MACROanalysis 
went well beyond the findings. It was true that the application of 
the new analytic technique res'ulted in the identification of new 
and broader patterns of behavior. The analysis was based, however, 
on on^ 32 minutes of classroom observation, and no evidence was 

♦ . ,* 
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presented showing that the new and broader patterns had determining 
influence on independent variables such as criteria of effectiveness. 
The findings would certainly not support the conclusion stated by 
the researchers that "MACROanalysis can be used to identify teacher 
behavior patterns which characterize and best facilitate the accom- 

plishment-af— the-goals-af-individual-science-progratn^ 

This is not to say that the techniqtxe does not have potential for 
identifying what constitutes effective science teacher behavior. 
Additional research may reveal some its potential, but the find- 
ings reported in the study alone would not support such optimism. 

; . ■ . ■ • • • ■ ■ 

The researchers' optimism concerning the potential of MACROanalysis - 
irnay have been directly related to .their assumption that the technique 
would result in the identification of predominant 'classroom behavior 
patterns. (A more exact statement of the assumption appears in the 
rationale.) If by predominant they- meant those behavior patterriis 
having determining or prevailing Influence on selected dependent 
variables, the conclusions would seem more. realistic. But the assump- 
tion, was questionable unless predominant behavior patteifn had some 
different meaning that, was not revealed by the research report. The 
statement, rather than being an as stamp t ion, was an excellent research 
problem in need of further inyeslJigatlon* 

In their definition of the problem, the researchers introduced MACRO- 
analysis and assumed that the application of the technique would 
result in predominant patterns of behayior that Reflected sequences 
of differei^t behaviors. Throughout the remainder of the^ report, they 
referred to patterns of behavior when discussing and coii5)aring the . 
results of MACRO analysis and macroanalysis The phrase, "sequences 
of diffei^ent behaviors," was not used again in the same context. 
If the researchers meant by the phrase that^MACROanalysis would 
simply result in different patterns of behavior, then an important 
aspect of their technique was possibly overlooked. If they actually 
meant that MACROanalys is would, result in sequences of different' 
behaviors or changes in behaviors, then they were inconsistent 
throughout the remainder of the report. If the latter were true. 
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tliey should not have used new patterns of behavior as .the criterion 
for determining the effectiveness of MACRDanalysi^. The technique 
by^ definition would result in new and different patterns of class- 
room; behavior . Regardless, the point to be made is that the 
researchers failed to capitalize on a very important contribution 

of~MACROanalysis: — application- of the -technique--resulted-in--the — 

identification of patterns of changes in behavior. 

Several 'q'ueist ions concerning the investigation and research report 
have been, raised, but they do not take away frop the fact ^ that MACRO- 
aiialysis Is.a v^ry interesting technique foiJ||analy zing cd^^d obser- 
Yational data. The technique should stimulate further research in 
the area of systematic observation of science classroom behavior. 
The following are several suggestions for future research, 

^'1. MACROanalysis could be used to re-examine the coded observa- 
tional data in existini^ studies of science classroom behavior. 

2. The relationships between patterns of behavior identified by 

' MACROanalysis and a variety of possible independent variables, 
- such as student gains and teacher characteristics, should be 
investigated. 

3. The potential of the technique' for identifying , characteristic 
teaching styles for individual teachers, various teaching 
strategies, and specific science programs should be investi- 
gated. ' . 

4. Since there is nothing sacred about a five-tally sejjj^nce of 
changes in behavior, the technique could be used to study 
sequences of behavior preceding or following a particular 
^ehavior or sets of behaviors. 



5. 



Subscripts could be used alojig with MACROanalysis to indicate 
the number of repetitive behaviors in a series. For example, 
the coded data AABBBCI^DEEEE would appear as A2B2C^D2E^. 
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Similar piatterns of changes of behavior coxild then be^analyzed 
for a variety of factors, including the amount of repetition 
with a given pattern. A profile for each pattern could be 
identified by placing the mean length or number of repetitions 
for each change of behavior in the subscript of the pattern. 
Such profiles could be investigated to determin e whe ther or not 
they more accuratlly^escribed the predominant pattern than 
simply listing the sequences of changes without subscript^. 
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Purpose . 



TJiis studlyvha'd/a . threef 9J.d purpose: 



xpis stuayvnaa 



l.^. > To provide ^^n overview of the ^students' growth during four years 
y > - t>t Studying the BSCS biology. 

. ♦\' '2. To.jtSentify,^ in the development of the project from its imple- 
V ^ mutation in 1965,. trends' in various aspects of students' 

' - achrlevfemient; which may have at least some generalizable attr^i- 

-bUt^^'V : [ . , ^ . ■ 



3. To assess tiie, feasibility of the BSCS adaptation in Israel by 

■ - ' i - ■ • » 

;^ comjJating^BSCS and .non -BSCS students regarding their achieve- 
ment in%ioio^y7^e'ir acquisition oj inquiry, skills and their 
attAtudej toward science and nature. 



Sp^ific ques'tidns involi^ed: ^ - . * • 

. '• . ■ ^ '^ ■ ^ ' \ ' " * / 

^ l. / .The growtlf of '.BSCS students regarding biological knowledge, 

^ ^' inquiry sjkllls, attitudes and understanding of science process. 

e^best^ predictors of student growth. , 

e effect of a BSCS course by comparing BSCS students with hon- 

^-BgCS studenrtaf-.- In addition, statistical comparisons assessed 
f-. differences due to sex, type of school, and ethnic background 
of students. 




Rationale 

In 1965 an adaptation of BSCS Yellow Version was ^introduced to Israli 
schools. By 1971 approximately one-half of the high school bUology 
classes, utilized this curriculum. ' This study sought to describe the 
intact of the BSCS Adaptation. 

■ ' , ■ ' . " ^ ■ *. • . 

Research Design and Procedure 

- ' . / 

n ■ 

Biology was taught for three periods a week to all ninth and tenth grade 
students. Those students choosing to specialize in biology continued 
their study during the eleventh and twelfth grades for four to five 
periods per -week. All students completed units dealing with Unity and 
Diversity while biology majors continued with Heredity, Evolution and 
Ecology.*'' At the'^end of the twelfth grade, all majors took a matricula- 
tion examination. ' i 

This study compared the achievement, attitude\ and process knowledge of 
the BSCS students and non-BSCS students^. Further comparisons were made ^ 
concerning ethnic background (European\v^rsus non-European) and among the 
BSCS students only regarding jsex differences and tyipe of school (city, 
rural and agricultural). 



The sample included three class populations of students whp entered t^e 
ninth grade in 1965, 1966, and 1967. 'Bfiese dlasses graduated in 1969, 
1970, and 1971. The comparison groups were selected as closely as possi- 
Vble fo.r types of students, teachers and schools. 

Since the instruments of evaluation had to test the dependent variables 
of achievement ^in cotltent, tinder standing of process, and attitude, the - 
tests were either (a) locally designed, (h) locally adapted, or (c) 
translated. To Insure worthwhile data,, the instrimients were administered 
at the most appropriate time. Listed below are the dependent variables, 
test of choice arid time of administration. ' 

., ■ ' ' ■ , 

1. IQ: . * * 

Ijlilta. test (locally designed), beginning of the ninth grade. 

55 

61 



2. Biological Knowledge: v 

General Biology Information Test (loyally designed) begin- 
ning of ^inth and end of tenth graded. ' * i j . 

BSCS Quarterly Tests (locally adapted), as unit^ were com- 
pleted. • i: 

3. Science Process: . ' r '\ ' 

_ — _ -TOUS-Form-W- (locally-adapted) , -beginning -of-nint^ 

end of tenth and twelfth gtades. 5 . ' i ' 

I 

SPI (translated), beginning of ninth grade and end, of t^nth, 
eleventh and twelfth grades. i 

, 4. Attitude: . | | 

Biology Attitude Inventory (locally constructed) , beginning 
of ninth and end of tenth grades;. 
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Inquiry Achievement: ^1 

Biology Process Test (locally designed), end of ten|h grade. 

'Practical Matriculation Test (locally designed), end of 
twelfth grade. 

Writtfen Matriculation Test (locally designed), end qf twelfth 
grade. ' ^ " / ' 



Findings 

Comparisons Among BSCS Students • 

1. BSCS appeared to be. adequate preparation for biology majors. 

2. Comparing the achievement of tenth grade boys and girls, no 
significant difference occurred. However, with biology majors, 
twelfth grade girls outperformed boys in understanding and 
dealing with inquiry processes. , J 

3. As students progressed from tenth grade (where deficiencies 
in mastery or inquiry skills existed) to twelfth grad^, the 
mastery l6vel of inquiry skills Improved. ; . . 

4. Regarding the students of city, rural (kibbutz) • and agricul- 
r tural (boarding) schools, only slight differences occurred 

betweeil the city-and rural schools. For all three classes, 
there was a conspicuous difference between the students from 
agricultural schools and those from city and rural schools. 
As for the twelfth grade majors, some of the differences 
disappeared. 
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5. The correlation between the various measures of. achievement 
, t ■ . •.' ■ . 

: ranged from 0.00 to 0.58. 

■Compav\8on8 of BSCS and non-'BSCS Students ' ' 

1. Although both mean scores and gains in biological knowledge at 

; the jMfcof the tenth grade were_ not me eti ng expected leve ls, 

BSCS sRidents did perform significantly better. 



2. Eleventh grade BSCS students outperformed non-BSCS students 
on the 'SPI. 

3. BSCS students scored significantly better than non-BSCS students 
* on^ most areas of Inquiry .skills measured by the Biology Process 

/ Test. 

4. BSCS students did not exhibit the "deficiencies'^' of non-BSCS 
students on the practical mode of the matriculation test. 



There was a significant difference between pupils^ of European 
and non-European parentage (in\ favor of pupils of European 
descent) in all types of cognitive measures in both experi- 
mental runs. 



Interpretations - 

1. The BSCS adaptation curriculum was dfoutid a3 successful as other 
biology courses in Israeli schools. V" In fact, BSCS was fomd 
superior In a few cases. • . 

2. BSCS was found mbre adaptable ^to city and rural schools than 
to agricultural schools* * 

3. BSCS adaptation was "less adequate" for lower IQ students and 
students of non-European descent. ^ 

4. To predict achievement, a variety of measures sliould be utilised. 
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ABSTRACTOR'S ANALYSIS 



This study provided an extensive description of the effect of the BSCS 
Adaptation Program in Israel during the first six years of implementation. 
It is important to note that the Adifptation Program referred to a trans- 
lated version of BSCS Yellow which was modified according to local flora, 



•fauna and culture. Further, .to obtain research data, several of the tests 
were locally constructed. Consequently, the generalizability of results 
is severely limited but the research methodology is not. 

The longitudinal nature of this study provided copious data* The 
researchers considered many dependent variables-— achievement , inquiry 
skills, understanding of process and attitude. The results were not 
inconsistent with other research comparing inquiry to traditionally 
oriented curricula. In some regards BSCS instruction was found superior 
to the conventional instruction. As for attitude and achievement by 
biology .majors, definitive conclusions are lacking. Likevise a predictor 
9f achievement was not fotmd. The description of inquiry, slg4.11s did not 
produce strong evidence favoring either form of biology instruction. 

Perhaps the most outstanding feature of the work is the dependence on 
locally constructed tests.. It must be assumed that (a) the locally con- 
structed tests are both valid and reliable, and (b) as they are revised, 
these tests may become a standard for future research in other cotmtries. 
Further, the use of criterion referenced tests provided the researchers 
the means to assess the impact of BSCS. It should be noted that a few 
^normative tests— the, SPI and BSCS Standardized— were utilized. With the 
SPI (and also the TOUS) , Israeli students "compared favorably xd.th U. S. 

a: 

and Australian students." 

Although the implications were limited in scope, questions for future 

research have arisen. Exaiiq)les which can be applied to most educational 

settings, include: - 

■ t . ■ ■ ■ 

1. Does the BSCS curriculum favor students with particular learn- 
ing styles? 

2. Since students involved in this study experienced "knowledge of 

* 

chemistry and physics, to. what extent does concurrent chemistry 
instruction enhance BSCS achievement? / 



3. What are vialid predictors of BSCS achievement? 

4. Are ptedictors of BSCS achievement Identical to predictors of 
conventional biology achievement? 

5. How is the acquisition of process skills related to BSCS 
achievement ? ^ 



6. To whaiE extent does the attitude of BSCS students differ from 
that of conventional students? 

7, What teaching characteristics are conducive to more effective 
BSCS achievement? ' ^ 

' - ■ '* ' ' ^.-j 

This study provided a means to assess the impact of a newly^'vlmplement^d 
curriculum. The procedure was sound and, coupled with th6 data, has pro- 

vided worthwhile questions for future research. 

■ \ • ' ^ . J 
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There were two main purposes of this study, One> obJectTive was to determine 
the extent of retention of chemistry knowledge among physiology students in 
a two-year community college by type of chemistry course background and by , 
the. length of time since completion of the qhemis try course. Also, beginning 
physiology students were compared with finishing chemistry students to^ deter- 
mine the areas of chemlst;ry most frequently forgotten. The second objective 
was to design a physiology laboratory with a chemistry review integrated Into 
it and to coiiq[)are the student* s performance with a control group taking a 
traditional physiology laboratory. 



Rattion 




The basis for the research was to attempt to improve student performance In 
physiology by using a unified science approach. Q^ie goal of unified science 
Is to have pupils achieve a greater understanding of science In both the 
cognitive and affective domains. Physiology students at Southwest College, 
which has an open door policy, tend to have poorly developed skills despite 
the fact that chemistry is a prerequisite for physiology. The author cites 
evidence that problem solving skills developed in one class carry over to 
another class. Thus, it is suggested that inadequate preparation in chem- 
istry may be related to the low achievement in physiology. The investigator 
expected the integrated course to affect the student *s appreciation, under- 
standing, and enjoyment of science as well as to improve his cognitive 
"performance, ' 



Development of Integrated Laboratory 
Exeroieea and Aahievement Teata 

The physiology labs that were developed consisted of a set of objectives, a 
materials list, a chemistry review and the physiology laboratory procedures. 
The content of the review was determined by examining the knowledge of chem- 
istry, required in the traditional physiology labs. By utilJaJ.ng an outline 
format, simplified instructions and background information in paragraph form 
with a question and answer section, no additional time was required for the 
experiments. > 

A multiple choice chemistry pretest was developed to measure eleven areas 
in chemistry, A physiology achievement test was formulated from three intro- 
ductory physiology tests .to measure student performance of the experimental 
and control groups at the end of the course. The contents of both tests 
were; validated by a panel cj'f experts and the :^liability was measured by 
aplit halves and the Spearjftan Brown formula. 

Sampling • ■ 

The subjects were nursing students enrolled in physiology classes which 
ranged in size from 8 to 28. The student body of the college is predomi- 
nantly ttdick. The number of classes was not specifically described but it 
appears that there were two experimental groups which had the chemistry 
review and two control groups which did not. 

Analyaia . 

The Investigator administered the chemistry pretest to measure* the first 
set of objectives which were related. to chemistry knowledge retention. 
The test results were analyzed with (multiple?) t-test according to back- 
ground and time. The chemistry background was categorized into three groups 
depending on where the students had taken chemistry. These were: AO in 

6i . ■ 




high school; B) at Southwest College; C) at a school other than A or B. On 
the basis of time students were also placed in three groups: A) students 
who had taken chemistry within twelve months; B) students who had taken 
chemistry within 13 to 48 months; C) students who had taken chemistry more 
than 48 months ago. The differences were, measured by t-test. 



*The~experlmental phase" of the research was~a^ To "~ 

test the differences in student performance between the control groups who 
did not get chemistry review and the experimental groups who did, a physio- 
logy test was administered and the results* were analyzed by/ t-tests. 



Findings 

1. For retention of chemistry knowledge according to background no signi- 
ficant differences bet;ween groups were found. ' The means for the groups 
were: A) high school chemistry, 25; B) Southwest College, 26; C) other 
college chemistry, 26.6. 

2. For retention of chemistry knowledge on the basis of time, the mean for 
Group A who had taken chemistry within 12 months was significantly 
higher than for Group B who had taken chemistry within 13 to 48 months 
or for Group C who had chemistry more than 48 months ago. The respec- 
tive means for the three groups were 32, 20.8 and 23.6. 

3. The investigator found that a loss o% chemistry knowledge occurred since 
the finishing chemistry students scored signif icantiy higher on the chem- 
istry t^st than did the beginning physiology students. The means were 
38.9 and 25 , respectively. Of the 11 areas tested, some were forgotten 
more than others, especially problem solving areas. The author did not 
report the number of items on the test. 

4. The investigator reported that the experimental groups scored signifi- 
ctotly higher than did the control groups* The means of the' two experi- 
mental groups were 65.42 and 61.61 while the control group means were 
59.90 and 53.29. The t value was not given but the author stated that 
it was significant at the 0.05 level. ^ v . 



62 



BS 



ERIC 



Interpretations 

From this study the Investigator drew the following conclusions: 

1* the chemistry backgrounds of students from different schools were 
comparable; 

. ■ c. ■ 

2, students who took physiology soon after completing chemistry had less 
trouble in physiology; 

3. some areas of chemistry were recalled more easily than other s;i.^|:he 
most difficult being those requiring analytical skills » ■> . 

... 

Several two-year nU'rsing programs are considering eliminating chemistry as 
a prerequisite for physiology. This study suggests that knowledge of chem- 
istry is important for a successful level of performance in physiology. 



abstractor; s analysis ^ 

This study addresses a problem that seems to be rather widespread; that is, 
the performance problems of students of science in colleges with an open 
door policy. Frequently the analytical skills the students need for success 
in courses are not well developed. For this reason, and because there is 
evidence ,that Skills developed in one science course carry over to another, 
Williams designed an^integrdted course. The body of research studies in 
M development ,ol|^^^^ied science is rather small and this study could add 



to that^ except tha^She reporting of the data is too incomplete for the 
study to be of empirical value, 




Although the study potentially has much to offer to the reader intefWPed in 
unified sciencd and health related curricula, there are several weaknesses 
which reduce the significance of the study. One relatively minor concern i# 
that the author concentrated on the affective outcomes in his rationale and 
literature review, but measured only cognitive outcomes. No affective out- 
comes were evaluated, even informally. 
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The miijor deficiencies^^, the study were in the statistical analysis and 
the reporting of the data. Sample sizes were not reported specifically and 
statistical tables were included for only one of the four research objectives. 
The Investigator ^stated, that the reliability of the instruments was deter- 
mined but failed to report" the results. In order to be tiseful to the. reader, 
the reporting of the results should be ^complete enough for an independent 
interpretation. If a mean is reported without either a range or standard 
deviation, it is meaningless. In this paper, since the; author did not report 
these or the t values, one simply has to take his word thart the findings are 
valid, for there is no way to make an independent judgment. 

Another fault of the study is the statistical analysis of the data. It 
appears that multiple, t test were used for a.nalysis since there were three 
groups compared for the first two objectives and four groups for the last. 
An analysis of variance would have been more appropriate and might have Jmde 
a difference in the findings, particularly for the fourth objective. yMulti- 
ple t-test's" sometimes show significance that doesn^t hold up tinder more 
rigorous j^alysis. It would have been interesting to see the results if 
the variables^ background and time, had been analyajB^ simultaneously with 
an ANOVA. Although no significant differences occurred between backgrotmd 
'groups, a significant difference was found for time variations. It seems 
likely that" most students in the high school chemistry group would not have 
had chemistry within 12 months and yet their scores were not significantly 
different from th'e other two groups. Without knowing, the number of items 
on the test, it is difficult to determine what those scores mean. 

For 'the analysis of the experimental ph§se of the study, Williams did not 
report the sample size^ the number of items on the physiology test, or the 
t values. Because of this, and because he did not' describe how he analyzed 
the resfixLts- exce^t^^^ the validity of the results is questionable. 



If lie Jiiad. four: gtjm and two control, with respective 

means of 65.42, *I^61;' 5^9. 90 :and. 53.29, thfen he must have collapsed the 



experin^ental anii^j^h'trbl groups xipto two/gr<^<[)S qr he must have done multi- 
ple t-tests. If col lapsed the grbups,V^o. means were given and the mean 

. . ■ ■. I ■■ • 

would not have befen the a:verage of . the . twci>si.nce the sample sizes were 

unequal* rf multiple t-test^ were us^dv fe^^ difference between the exper- 

imental grou]^.^ 61.61, and the control group, 59.0, does not look like it 



would be significant.. In either case, without more' information it is 
Impossible to make an accurate assessment which places the validity of 
the whole study in jeopardy. - 

This stiidy could have made a valuable empirical contribution by providing 
evidence for the notions that knowledge learned in one science course has 
carryover value to another, that chemistry is a necessary prerequisite 
for some of the life sciences, that a unified approach is an appropriate 
means of increasing studerit performance, eXc. However, the limitations 
of the reporting and analysis undermine even the basic findings. 
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